Anomalous dynamic back-action in interferometers: beyond the scaling law 
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We analyze dynamic optomechanical back-action effects in signal-recycled Michelson and 
Michelson-Sagnac interferometers that are operated off dark port. Up to now, their optomechanics 
has been studied under dark port condition only. For the dark port case and in the context of 
gravitational wave detectors, the 'scaling law' assured that all back-action effects can be understood 
on the basis of the much simpler topology of a Fabry- Perot interferometer. Off dark port, our the- 
oretical and experimental analysis reveals certain 'anomalous' features as compared to the ones of 
'canonical' back-action, obtained within the scope of scaling law. In particular, optical damping as a 
function of detuning acquires a non-zero value on cavity resonance, and several stability/instability 
regions on either side of the cavity resonance appear. We report on the experimental observation of 
these instabilities on both sides of the cavity resonance in a Michelson-Sagnac interferometer with 
a micromechanical membrane. For a certain region of parameters, a stable optical spring (that is 
positive shifts of frequency and damping) in a free-mass interferometer with a single laser drive 
are possible. Our results can find implementations in both cavity optomechanics, revealing new 
regimes of cooling of micromechanical oscillators, and in gravitational- wave detectors, revealing the 
possibility of stable single-carrier optical spring which can be utilized for the reduction of quantum 
noise in future-generation detectors. 



I. INTRODUCTION 

It is a fundamental result of quantum measurement 
theory that in any optomechanical system, where light 
serves as the quantum readout agent interacting with a 
mechanical probe (test mass) via radiation pressure, the 
probe is subject to measurement back-action [1—3]. This 
comprises on the one hand back-action noise, that is ra- 
diation pressure noise on the test mass due to quantum 
fluctuations of the electromagnetic field. Together with 
measurement shot noise it gives rise to the celebrated 
standard quantum limit (SQL) of measurement precision 
[4-6]. The first observation of measurement back-action 
noise has been reported only very recently in Ref. [7] . On 
the other hand, modulation of the optical field by the 
motion of the probe (caused by any external forces) pro- 
duces a ponderomotive radiation pressure force, which 
depends linearly on the displacement of the mechanical 
probe, and in turn alters the dynamical properties of the 
latter — this effect is referred to as dynamic back-action, 
and was first recognized in [8, 9] in the context of mi- 
crowave cavities. 

If the mechanical probe represents an oscillator, the 
dynamic back-action of light produces two effects: (i) op- 
tical rigidity (or optical spring) — a shift of the resonance 
frequency of the oscillator, and (ii) optical damping — a 
shift of the intrinsic damping rate of the oscillator. The 
experimental demonstration of the optical spring effect 
in a suspended Fabry-Perot cavity was reported in [10], 



while optical damping was utilized in a series of recent 
experiments on back-action cooling [11, 12] of microme- 
chanical oscillators [13-21], eventually to the quantum 
ground state [22, 23]. 

If the mechanical probe realizes a (quasi) free mass, as 
is the case of interferometric gravitational- wave detectors 
(GWDs), the dynamic back-action effectively transforms 
it into an oscillator whose rigidity and damping can have 
a rather complicated frequency dependence. In the con- 
text of GWDs this flexibility in tailoring the probe's dy- 
namical properties was considered as a tool to increase 
the measurement sensitivity. In [24] the so-called intra- 
cavity readout GWD topology was suggested which uti- 
lized the optical rigidity. The sophisticated frequency 
dependence of the optical spring in the long Fabry-Perot 
cavities of GWDs was further analyzed in [25] and inde- 
pendently in [26] . Later on, it was shown that exactly the 
same frequency dependence arises in the dual-recycled 
topology of modern GWDs [27]. Ref. [28] derived the 
scaling law which provides a general framework for un- 
derstanding dynamic back action in GWD topologies: it 
states that the dynamical and noise properties of any 
interferometer with high-finesse differential mode oper- 
ated on a dark fringe (at dark port), are equivalent to 
the ones of a single Fabry-Perot cavity with correspond- 
ing effective linewidth, detuning and circulating optical 
power. In particular, the scaling law covers signal- and 
dual-recycled interferometers with or w/out arm cavities, 
and non-signal-recycled ones with arm-cavities. Based 
on this work, further studies of quantum-noise sensitiv- 
ity of detuned-signal-recycling topology were performed 
[29, 30]. 
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At the early stages of designing of the second- 
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FIG. 1: Schematic of a signal-recycled Michelson-Sagnac in- 
terferometer as theoretically and experimentally investigated 
in this work. Inset: in the limiting case of 100% reflecting 
membrane Michelson-Sagnac interferometer is equivalent to a 
pure Michelson interferometer. 



generation GWDs, like Advanced LIGO [31], the opti- 
cal spring had been considered as the viable technology 
for suppression of quantum noises. Unfortunately, in the 
'canonical' case of dark-port-tuned interferometers con- 
sidered in Rcfs. [27, 28], the positive optical spring is al- 
ways accompanied by a dynamical instability (negative 
damping). In Refs. [32, 33] it was shown theoretically and 
demonstrated experimentally that a stable configuration 
can be created by means of two optical carriers detuned 
to opposite sides of the interferometer resonance curve. 
Sensitivity issues of stable double-pumped optical spring 
were considered in Refs. [34, 35]. This idea was further 
developed into the concept of negative optical inertia [36] , 
which also requires two oppositely detuned carriers and 
can be used for broadband suppression of quantum noise. 

It became clear later on, however, that in the second- 
generation GWDs, due to sensitivity limitations imposed 
by the classical noise sources, in particular, coating Brow- 
nian noise of the test masses, only modest gain can be 
provided by the optical spring, which does not justify the 
accompanying technical difficulties (instability or the ne- 
cessity to use two carriers). As a result, optical spring 
is currently not considered as an option for the second- 
generation GWDs [37]. The situation is different for the 
third-generation ones [38-40] . In these detectors classical 
noises will be reduced significantly (by implementing un- 
derground facilities, cryogenic cooling of the test masses, 
using low-loss and low-noise coatings, etc.), creating vast 
space for reduction of quantum noise. In this scenario, 
viable schemes for stable single-carrier optical inertia, as 
well as stable single-carrier optical spring are very desir- 
able. 

In this article we consider the dynamic back-action 



in a signal-recycled (SR) Michelson or Michelson-Sagnac 
(MS) interferometer, see Fig. 1, in a generic regime of 
operation off dark port. This is - to the best of the au- 
thors knowledge - the first analysis of back-action effects 
in interferometers operated in this mode. We empha- 
size that the generic way of performing a conventional, 
single photo-diode homodyne readout (DC readout) ac- 
tually requires to tune the interferometer off dark fringe. 
Our analysis reveals certain 'anomalous' features of dy- 
namic back-action, as compared to the ones of 'canonical' 
back-action, obtained within the scope of scaling law for 
interferometers operated on dark port. In particular, in 
the MS interferometer, given the finite reflectivity of the 
membrane, optical damping as a function of detuning 
acquires (i) non-zero value on resonance and (ii) several 
stability/instability regions on either side of the cavity 
resonance. We present experimental data on a signal- 
recycled MS interferometer containing a SiN membrane 
that, once operated off dark port, indeed exhibits two 
distinct instabilities on either side of the SR cavity res- 
onance. In the case of a perfectly reflecting membrane, 
which corresponds to a simple Michelson interferometer, 
the off-dark-port regime similarly results in several in- 
tersecting regions of positive/negative values of optical 
rigidity and damping. For a certain region of parame- 
ters, stable sets of both effects in a free-mass interfer- 
ometer with a single laser drive are possible. Our re- 
sults can find applications in both cavity optomechanics, 
revealing new regimes of cooling of micromechanical os- 
cillators, and in the gravitational-wave detectors, reveal- 
ing the possibility of stable single-carrier optical spring 
which can be utilized for the reduction of quantum noise 
in future-generation detectors. 

Our results for generic signal-recycled Michelson and 
MS interferometers are related to and consistent with 
corresponding findings for high-finesse optomechanical 
cavities exhibiting a so-called dissipative (or reactive) 
optomechanical coupling. In this case, mechanical dis- 
placement shifts the line width of the cavity, and not 
its resonance frequency, which gives rise to Fano reso- 
nances in the back-action noise spectrum, as was shown 
in [41]. Traces of such a coupling have been observed in 
[42]. Several theoretical studies explored the rich impli- 
cations of this coupling on position sensing and mechan- 
ical squeezing [41, 43], normal mode splitting and mul- 
tiple regions of instability [44, 45]. Some of the authors 
showed recently that a pure dissipative optomechanics 
can in fact be achieved in a MS interferometer with a 
scmitransparent micromechanical membrane [46] . As we 
show here, the feature of Fano resonances in back-action 
noise, and associated anomalous effects in damping and 
rigidity, have to be expected as a generic property of 
Michelson and MS interferometers operated off dark port. 

This paper in organized as follows. In the first part 
(Sec. II) we compare 'canonical' dynamic back-action, de- 
rived within the scope of scaling law, to the 'anomalous' 
one which is rigorously derived in the second part. We 
apply the transfer matrix approach to the propagation of 
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fields inside the interferometer (Sec. Ill), in the spirit of 
Ref . [3] . We compute optical fields on the membrane sur- 
faces and corresponding radiation pressure force, which is 
the sum of a stochastic part (back-action noise, Sec. IV) 
and a dynamical part (dynamic back-action, Sec. V). In 
Sec. VI we report on the experimental observation of in- 
stabilities on both sides of the cavity resonance in a 
Michelson-Sagnac interferometer with a micromechani- 
cal membrane. Finally, we analyze certain properties of 
the obtained quantities and draw conclusions. 



II. CANONICAL AND ANOMALOUS 
DYNAMIC BACK-ACTION 

The dynamic back-action /C(f2) is defined as the coef- 
ficient of proportionality between the ponderomotive ra- 
diation pressure force F X (Q) and displacement of the me- 
chanical probe x(Cl), F x (Cl) = — K,(Q)x(iY). It comprises 
the optical spring K(Q) — 9?[/C(f2)] and optical damp- 



ing r(0) 



- lev 



[/C(f2)]/f2, such that the corresponding 



shifts of the (square of) mechanical frequency and me- 
chanical damping rate are K/m and T/m, with m being 
the oscillator's mass. So far, the dynamic back-action 
has been studied in the literature only for interferometers 
perfectly tuned to dark port. According to the scaling 
law [28], any interferometer with high-finesse differential 
mode and operated at dark port, can be equivalently de- 
scribed by a single Fabry- Perot cavity with effective half- 
linewidth 7, detuning A and circulating optical power 
Pcav Thus, the optical spring and damping in an inter- 
ferometer reduce in this case to the well-known ones of a 
FP cavity [25], 

2uj £ A(A 2 + 7 2 ~» 2 ) 
K ( il ) ~ —FT —0. I TrvT^T? ' ( la ) 



r(fi) 



L 2 |A 2 + ( 7 -^) 2 | 2 ' 
2uj q £ A7 
L 2 |A 2 + ( 7 -^) 2 | 2 ' 



(lb) 



where ujq is laser carrier frequency, £ = 2LP cav /c is the 
optical energy stored inside the cavity and L is cavity 
length. These 'canonical' rigidity and damping posses 
the following characteristic features: (i) both are anti- 
symmetric with respect to A and vanish at A = 0, (ii) 
r as a function of A crosses zero only once, thus being 
positive for A < and negative for A > — these re- 
gions are usually labeled as stable (cooling) and unstable 
(heating), (iii) K as a function of A crosses zero once if 
7 > Q (case of free-mass interferometers) and (iv) three 
times otherwise (case of micromechanical oscillators in 
the resolved sideband limit). These properties are illus- 
trated in Fig. 2a. In a Hamiltonian formulation of cavity 
optomechanics Eqs. (la, lb) follow from H lnt 



g^xa^a, 



with g u being the coupling constant between intracav- 
ity field a and position of the mechanical oscillator x [2] . 
This is usually addressed as dispersive coupling, since 
the mechanical oscillations modulate the cavity eigenfre- 
quencies. 



0.5 


-0.5 
-1 



— -* * ) t _ " 






K, 7 < 




\ 


— r 


1 / Nv 














a 





A/7 



,x 10 




1 

0.5 


-0.5 

-1 - 

20 
10 


-10 



\ ; 

V , 


W b 


-2 2 

A/7 








1 d 


-5 5 



A/7 



FIG. 2: Optical spring K and optical damping V as functions 
of detuning (in units of cavity half-linewidth 7). Curves are 
plotted for the following parameters: membrane power re- 
flectivity = 0.17 (except b), SRM transmittance Xf R = 
3 x 10 -4 , beamsplitter asymmetry Sbs = 0. a. Normalized to 
maximum values 'canonical' K and F denned in Eqs. (la, lb). 
b. Normalized to maximum values K and V for the MS in- 
terferometer with 100%-reflective membrane (equivalently, a 
pure Michelson interferometer), detuned from dark port at 
Slop = Ao/4 by 81 — Slop ~ O.OIAq. Ratio of the mechanical 
frequency to cavity linewidth is fi/7 ~ 10 -2 . Optical damp- 
ing (c) and spring (d) for a MS interferometer detuned from 
dark port at Slop = 3Ao/4 by SI — Slop ~ O.OlAo, input opti- 
cal power Pi n = 200 mW, laser carrier wavelength Ao = 1064 
nm, effective cavity length C — 8.7 cm and fi/ 7 ~ 1. 



Our analysis in Sec. V shows that in a signal-recycled 
MS interferometer these features expectedly hold in dark 
port, but if detuned from it, features (i) — (iii) break. In 
this sense we refer to the dynamic back-action in a MS 
interferometer operated off dark fringe as 'anomalous'. 
In particular, both K and Y become highly asymmetric 
and acquire non-zero values at A — (see Fig. 2c, d), so 
that for certain region of parameters F|a=o > — this 
is cooling on resonance (see upper inset in Fig. 2c). Also 
optical damping can cross zero several times, acquiring 
additional regions of stability/instability (see lower in- 
set in Fig. 2c), thus allowing another regime of cooling. 
In Sec. VI we report on the experimental observation of 
these instabilities on both sides of the cavity resonance 
in a Michelson-Sagnac interferometer with a microme- 
chanical membrane. Non-zero K at A = implies a shift 
of the mechanical frequency on resonance, though for mi- 
cromechanical oscillators it is mostly negligible compared 
to intrinsic mechanical frequencies. 

An extreme case of a 100% reflective membrane cor- 
responds to a pure Michelson interferometer, i.e. repro- 
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duces basic topology of the GW detectors. The coordi- 
nate x of the mechanical degree of freedom refers then 
to the differential motion of the end-mirrors in the arms 
of the Michelson interferometer, cf. Fig. 1. For a GW 
detector being a free-mass interferometer the effect of 
optical spring is not negligible, since it transforms (al- 
most) free test masses into mechanical oscillators with 
resonance frequencies lying in the GW observation band, 
where typically < 7. Thus, if a detuned interferome- 
ter is operated at dark fringe, Eqs. (la, lb) imply either 
K > 0, T < for A > 0, or K < 0, T > for A < 0. This 
means that for a single laser drive a set of 'canonical' K 
and T is unstable in both cases. 

It is rather intriguing, however, that the well-studied 
Michelson interferometer also exhibits 'anomalous' dy- 
namic back-action if operated off dark port, violating 
features (ii) and (iii) of the 'canonical' one: according to 
Eq. (13), two regions of positive/negative values can arise 
in both K and T, as illustrated in Fig. 26. For a GW de- 
tector this opens up a region of parameters where sets of 
K and T result in a stable configuration for a single laser 
drive. Indeed, one can notice in Fig. 26 a ceratin range of 
negative detunings where both optical spring and damp- 
ing are positive, indicating a possible stable state, which 
is confirmed by the accurate analysis of stability in terms 
of Routh-Hurwitz criteria. Moreover, an 'anomalous' op- 
tical spring (not necessary stable) can naturally occur in 
any detuned interferometer with a DC-readout (like Ad- 
vLIGO or GEO-HF [47]) when an offset from dark fringe 
is created on purpose to get a small fraction of mean 
power for the homodyne detection. 

Ref. [46] considered a MS interferometer with 100% re- 
flective recycling mirror in a general regime of opera- 
tion. In an effective-cavity approach (valid for a high- 
finesse signal recycling cavity) it was shown there that 
the system can be described by a Hamiltonian iJi nt — 
g UJ (x)a ji a+g 7 (x) J du^a^a— h.c). The last term describes 
coupling of the cavity field a to the continuum of modes 
a w of the in/out-going external field, which will cause 
an amplitude decay (linewidth) oc g'i. In this system, 
the mechanical oscillator modulates both, the cavity res- 
onance (via g u ) and the cavity linewidth (via g 7 ). These 
two aspects are referred to as dispersive and dissipative 
coupling [41, 45], respectively. Therefore, in a regime 
where an effective cavity description is adequate, devi- 
ations from Eqs. (la, lb) can be explained by the emer- 
gence of dissipative coupling in addition to the dispersive 
one and interplay between them. However, in interfer- 
ometers where such a description is not valid these la- 
bels cannot be unambiguously attributed. We therefore 
shall further talk of the interferometers operated at or off 
dark fringe as demonstrating 'canonical' or 'anomalous' 
dynamical back-action. 'Anomalous' back-action in this 
sense is the generalization of the 'canonical' one, which 
corresponds to the particular case of dark-port-tuned in- 
terferometers, and thus violates the scaling law. 



III. PROPAGATION OF FIELDS 

Consider a Michelson-Sagnac interferometer as shown 
in Fig. 1 with a central beamsplitter BS having ampli- 
tude reflectivity i?es = y(l - <5bs)/2 and transmissivity 
Tbs = \J{1 + <5bs)/2, two steering mirrors Mi and M 2 
both having 100% reflectivity, a semitransparent mem- 
brane m with amplitude reflectivity R m and transmissiv- 
ity T m , and a signal-recycling mirror SR with amplitude 
reflectivity i?sR and transmissivity Tsr. The interfer- 
ometer is driven by a laser L through laser port which 
is usually labeled as 'bright port'. Photons emanating 
through the other, detector (or 'dark') port impinge on 
a detector D (homodyne or heterodyne). Note that if 
the offset from dark fringe is large enough, traditional la- 
bels 'bright' and 'dark' port become ambiguous. Unless 
mentioned explicitly, we neglect losses. We denote the 
distance between SR mirror and BS as Zsr,j arm length 
as L and the distances between folding mirrors Mi and 
M 2 and membrane as h = I — 81/2 and I2 = I + 51/2, 
respectively. This means that l\ + I2 = 21, I2 — h = 51 
and the mean position of the membrane on the cc-axis 
is (x) = 51/2. The total length of the SR-m path is 
C = L + I + l SR . 

In any spatial location inside the interferometer we de- 
compose the electric field of the coherent, plane and lin- 
early polarized electromagnetic wave into the sum of a 
steady-state (mean) field with amplitude A and carrier 
frequency ujq (wavenumber fco = loq/c and wavelength 
Ao = 2-7r/fco), and slowly-varying (on the scale of 1/wo) 
perturbation field with amplitude a(t) describing vacuum 
noises and the contribution from the motion of the mem- 
brane, 

A(t) = [A e-- 04 + a(t)e-» ot ] + h.c, 

/+°° dO 
a(co + n)e- mt ^. 
-00 2?r 

Here A is the area of laser beam's cross-section and c is 
the speed of light. Unless mentioned explicitly, we will 
deal with fields in the frequency domain only. We will 
therefore omit frequency arguments for briefness. 

The laser L emits a drive-wave A^ with mean ampli- 
tude Alo and optical fluctuations ol- For simplicity we 
assume that there are no technical fluctuations so that 
the laser is shot- noise limited, [cil(wo + ^)> a^wo + f^')] = 
2n5(n — O'). The vacuum field A^ entering through the 
SR mirror (SRM) from detector port has zero mean am- 
plitude but non-zero vacuum noise an , uncorrelated with 
vacuum noise from the laser port and obeying the sim- 
ilar commutation relation [avi^o + tt), a^wo + fi')] = 
2ir5(£l — fi'). We unite these into vector-column of input 
fields A[ n = (Al,Ad), so that the vector of mean input 
fields is Ai n o = ( Alo , 0) and the vector of perturbation 
fields is ai n = (oljOd). Due to linearity of the system 
input fields can be propagated throughout the interfer- 
ometer as independent Fourier components. 
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Consider first the case without SRM and with a fixed 
membrane. The latter condition allows us to treat mean 
and perturbation fields on equal footing. Input fields 
(in this case coinciding with the fields incident on the 
beamsplitter) linearly transform into the output fields: 
first they split/combine on the beamsplitter, travel along 
distances L in both arms, reflect from the steering mir- 
rors, travel distances hp towards the membrane, re- 
flect/transmit on it, then travel backwards distances ?i j2 
and L and finally recombine at the beamsplitter. Each 
transformation is defined by the corresponding transfer 
matrix and the round-trip of light is defined by their 



product, A ont 
Here 



iBgrL^lVVif iif LlVJlBS ^in 



M BS = ( l BS ~M , 



m 



(2) 



are the transformation matrices of beamsplitter and 
membrane, both chosen in real form (this is always pos- 
sible due to Stokes relations), and 



AkL 









AkL 



p* 



/7>7 i 
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are the propagation matrices comprised of the phase 
shifts along the horizontal/vertical arms (of length L) 
and diagonal half-arms (of lengths Z1.2) ■ For mean fields 
one should apply the substitution k = k and for per- 
turbation fields k = k + K = k + fi/c. The matrix 
Mms thus represents the transformation matrix of a non- 
recycled Michelson-Sagnac interferometer 



IMS 



2ik(L+l) ( Pi T 
T P2 



with 



Pi — Rm (R 



/km 



BS' 



P2 = Rm (Ti s e lkSl 



rp2 -ik5l\ 
~ J BS e J 

r>2 -ik&l\ 
K BS e ) 

ikSl 1 „ — ikdl\ 



2T m i?Bs7BS, 

2T m i?Bs7BS7 

r = R m R BS T BS (e ikSl + e-* kSl ) + T m (T 2 s - R 2 BS ). 



Physically pi is the reflectivity of the input laser field 
back into the laser port, p 2 = — p* is the reflectivity of 
input vacuum field back into detector port, and r is the 
transmissivity of the laser field into detector port and 
vacuum field into laser port. One can check that the ma- 
trix Mms is unitary, thus non-recycled MS interferome- 
ter can be described as an effective mirror with reflectiv- 
ity and transmissivity depending on membrane position 
via SI. The dark port (dark fringe) condition for the 
interferometer is achieved when the cross-transmittance 
between input-output ports vanishes (in particular, no 
mean power leaks into the detector port), corresponding 
to t — 0, or explicitly 



cos k Sl = — -7^- 



5bs 



Rm 



(3) 



BS 



In the case of a symmetric beamsplitter (#bs = 0) this is 
satisfied for SI — n\ n /4 and odd n [56] . 



If the SRM is inserted then the out-going field in the 
SR port is reflected back, such that the in-going fields 
incident on the beamsplititer are defined by the equation 



A BS = PRT R Ain + PrMrPrMmsAbs- 



(4) 



Here A BS = (A BS i, A BS2 ) is the vector-column of in- 
going beamsplitter fields (see Fig. 1), Rr = diag(0,i?sri) 
with zero standing for the absence of power-recycling mir- 
ror in laser port, Pr = diag(I, e lfc ' SR ) is the propagation 
matrix in BS-SR path, and Tr = diag(I,TsR,). Thus 
the first summand on the RHS of Eq. (4) stands for the 
input fields directly incident on the beamsplitter, while 
the second summand corresponds to a single round trip 
along the interferometer with reflection from the SRM. 
Solution of this equation yields 



IBS 



(I -P. 



R^RlfROTMS 



)- 1 PRT R A in , 



(5) 



where I is the 2x2 unity matrix. Denote inverse matrix 
in this solution as 



mvtsRi 



Kmsr - \ ( RsR re^c J 



V = 1 - R S RP2e 



2ikC 



This tells us that the MS interferometer with SR mir- 
ror makes an effective Fabry-Perot cavity with associ- 
ated resonance factor 1/2?. The matrix element K^g 2 R 

describes a resonant amplification of input vacuum field 

(2 1) 

inside the cavity, while K MSR corresponds to the laser 
field being partially transmitted into the SR port (hence 
the proportionality to r) and also enhanced inside the 
cavity. In the ideal dark-port regime cross-transmittance 
is suppressed, all laser field is reflected back into laser 
port, and only the vacuum field from the detector port 
resonates inside the cavity. 

Note that the effective detuning of the laser carrier 
from cavity resonance(s) is not solely defined by the 
corresponding shift in frcqunccy (or cavity length) in 
contrast to the ordinary Fabry-Perot cavity. Assume 
that kC = ttN + 8kC, N is integer, SkC <C 1, and 
arg/9 2 = </>dp + S(f>, where DP = argp 2 |dark port and 5(p 
is the deviation from it due to offset from dark fringe via 
membrane positioning. Then one can rewrite the inverse 
resonance factor as 

V = 1 - J? SR |p 2 |e 2 ^ £ + iars ^ = 1 - R SR \p 2 \e 2lAkC , 

such that the full detuning 



A k =(Sk + 



<PDP 

2C 



(6) 



is the sum of the 'conventional' detuning 5 — c5' k of car- 
rier frequency from cavity resonance at dark port, and an 
additional detuning 5(f>/ (2£) corresponding to the offset 
from the latter. 

The narrow-band limit is achieved when both SR mir- 
ror and compound 'interferometer' mirror possess high 
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reflectivity, 1 - R S r « T| R /2 < 1 and 1 - \p 2 \ ~ t 2 /2 < 
1. The half-linewidth of the cavity is then 

= „ cTj R cr 2 

' 2C/c ~ AC AC' K ' 

Therefore, the total cavity lincwidth accounts for finite 
SRM transmittance and finite transmittance of the in- 
terferometer operated off dark port; since r = t(51), the 
latter contribution describes modulation of the lincwidth 
by the motion of the membrane, thus implementing dis- 
sipative coupling, as discussed already in [46] . If the op- 
tical losses in the system are symmetric with respect to 
interferometer arms, then one can add the corresponding 
loss factor to T| R , since it is the SRM that couples vac- 
uum noise into the interferometer. Otherwise, one can 
take asymmetric losses into account, for example, by as- 
signing finite transmittances to the steering mirrors Mi^ 
and taking into account vacuum noises entering through 
them. 



IV. STOCHASTIC BACK-ACTION 

In order to determine the radiation pressure force act- 
ing on the membrane we need to determine the fields on 
the membrane surfaces. In-going fields on the beamsplit- 
ter (5) propagate along the arms and transform into the 
fields incident on the membrane (A m i,A m 2) = A m = 
¥i¥ L M BS A BS and reflected from it (-B m i,-B m2 ) = B m = 
M m j4 m , see Fig. 1. In terms of input fields 

A m = M A A in - M A = PjPlMbsKmsrPrTr, (8a) 
B m = M B A in : M B = M m P;P L M BS K M SRPRT R . (8b) 

The components of matrices and Mb are presented in 
the Appendix. Denote these transfer matrices separately 
for mean fields as M Ao = M A \ k=ko , M Bo = M B \k=k and 
perturbation fields as M a (fi) = M.A\k=k +K, M(,(0) = 
M B \ k=ko+K . 

The radiation pressure force exerted on the membrane 
is then given by 

F(t) = ~ (A 2 ml {t) + B 2 ml (t) A 2 a2 (t) BUt)) , 

(9) 

where averaging is performed over the period of electro- 
magnetic oscillations. Ignoring the D.C. contribution and 
linearizing with respect to perturbation terms, the spec- 
trum of the force reads 

F BA (Q) = 2hk Q R m A*J Q Mf o M b (n)a in (iu + SI) 

+ 2hk Q R m Af na MlM* b (-n)(4 n (Lo Q - SI). 

This is the radiation pressure noise, also addressed 
as back-action noise or stochastic back-action, i.e. the 
time-varying radiation pressure that is solely caused 
by the fluctuations of optical fields. The unsym- 
metrized spectral density of stationary back-action noise 



is computed from the equation 2ir5(Sl — SI')Sf(Q') — 
(0|F BA (ft)4 A (Q')|0>, yielding 

W~^MF{ |il(0)|2 + 7|R|S)(0)|2 }' 

(10) 

&(Sl) = ai (1 + R 2 SR e 2 * KC ) + a 2 i? S Re 2i(fe0+K)£ 

+ a* 2 R SR e-^ k « c , 
D(Sl)^(3 1+ /3 2 R SR e^ koC , 

ai = T m R BS T BS (e lkSl + e^ kSl ) - R m (T 2 s - i?| s ), 

a 2 =T 2 s e* kSl +R 2 BS e^ k5 \ 

A = T m (T 2 s e ik51 - R 2 BS e- ikSl ) + 2R m R BS T BS , 

Q d t* ( Ak8l „ — ik5l\ 

Pi = -KbsJbs (e -e ). 

Here P; n = fi^ol^Lol 2 is the input laser power, T> = 
2?|fc=fe is t ne resonant multiplier for mean fields and 
T>(Sl) = V\k=k +K is the resonant multiplier for per- 
turbation fields. Remember though that the measur- 
able spectral density of stationary noise is the sym- 
metrized one. For back-action noise it is evaluated 
from the symmetrized relation 2ttS(SI — SI')Sf(Q') — 
±<0|F BA (O)F BA (ft') + F BA (ft)F BA (tt')|0), or explicitly 
S F (Sl) = |5 F (H) + §S F (-f2). However, the unsym- 
metrized spectral density makes a useful calculational 
tool, since in addition to its symmetric part being the 
measurable spectral density of back-action noise, its anti- 
symmetric part is proportional to the introduced optical 
damping (see Sec. V). It also possesses certain heuris- 
tic value, in particular, giving an insight into the phe- 
nomenon of quantum noise interference. In this regard we 
refer also to the considerations presented in Ref. [48] on 
the interpretation of noise measurements of the ground- 
state cooling experiment [23] . 

The factors £ and 23 in Eq. (10) describe contributions 
of vacuum noises from laser (<zl) and detector ports (an) 
respectively. Note that the contribution of a B vanishes 
in the case of 100% reflective SR mirror, which is the 
case considered in Ref. [46]: enters the interferome- 
ter and, if the latter is slightly offset from dark fringe, a 
small portion of cil is transmitted into the SR port and 
gets enhanced in the effective cavity. Therefore, the field 
on the membrane surface is the sum of two fields, one 
that directly entered the interferometer from the input 
port and a second one which is given by the intracavity 
field. The former contribution is white shot noise while 
the latter one is the white noise Lorentz-filtered by the 
cavity, such that their interference leads to an asymmet- 
ric Fano-like profile in the shape of Sf(SI), as described in 
Ref. [41]. Indeed, the frequency-dependent factor £(fi) in 
Eq. (10) distorts the Lorentz-type denominator T>(Sl) cre- 
ating an asymmetric profile with a characteristic dip at a 
particular frequency ^Fano where Sf(£Ifmlo) = 0, being 
the result of negative interference between input and in- 
tracavity fields, see Fig. 3a. In cavity optomechanics this 
is identified with the emergence of dissipative coupling 
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— £ = 0.45Ao 




— | = 0.50A 
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FIG. 3: Normalized (non-symmetrized) spectral densities 
of back-action noise for different membrane positions, £ = 
51 — 52dp and Slop is defined by Eq. (3). For better visu- 
alization we choose membrane power reflectivity = 0.3, 
beamsplitter asymmetry 8bs = — 0.3 and detuning A = 0. a: 



Rt 



1. b: Ri 



0.7. 



[41, 45, 46] 

The expression for f^ano is derived from the equation 
for |£(f2)| 2 =0. In a narrow-band and low-frequency ap- 
proximation one finds £(fi) fts 2(a% + 5fta2) + 2iQ— (ai + 
Ka 2 +«3Q!2) + 2iA-§2i3a2, where a 2 = a 2 e~ iaTgP2 and 
A = cAfe is the detuning in frequency. In the par- 
ticular regime of pure dissipative coupling the constant 
term (corresponding to dispersive coupling) vanishes, 

a\ + ^i&2 = 0, SUCh that £(fiFano) = if fiFano = — 2A, 

in agreement with Ref. [41]. 

Note also that if the interferometer with perfectly sym- 
metric beamsplitter is tuned to dark port, the contribu- 
tion of vacuum noise from the laser port in the back- 
action spectral density vanishes. This happens because 
counter-propagating beams in two arms are perfectly cor- 
related so that the radiation pressure fluctuations caused 
by them cancel each other. 

In a realistic interferometer, the SR mirror is not 
100% reflective, therefore ar> enters the interferometer 
and gets resonantly enhanced. One would expect that 
its contribution to back-action noise has the form of a 
Lorentz factor, since there is no white vacuum noise from 
detector port to interfere with. Indeed, the factor D 
is frequency- independent, such that the frequency de- 
pendence of the od contribution is solely defined by a 
Lorentz- type denominator T>(fl), corresponding to pure 
dispersive coupling in an effective cavity. Therefore, in 
the back-action spectral density, the Lorentz-like sum- 
mand adds to the Fano-like summand, leading to the 
blurring of characteristic features of Fano curve as illus- 
trated in Fig. 3&. Vacuum noise from detector port no 
longer allows SV(f2) reaching zero, although the dip near 
^Fano is still present. In an interferometer with symmet- 
ric beamsplitter and tuned to dark port, the contribution 
of vacuum noise from laser port cancels out, leaving only 
a pure Lorentzian back-action of vacuum noise from de- 
tector port. 



V. DYNAMIC BACK-ACTION 

Consider now a movable membrane with position op- 
erator x m (t) with a corresponding Fourier-transformed 
operator :r m (f2). According to perturbation the- 
ory the fields on the membrane surfaces will have 
contributions of zeroth and first order in the me- 
chanical displacement. One finds B m o = M m A m0 
and b m = M m am + 2ik x m R m A m( ). Thus the per- 
turbation fields now contain both optical noises 
and the displacement of the membrane. Since 
the treatment of mean fields remains unchanged, 
we consider only the perturbation terms. The in- 
going fields on the beamsplitter are defined by the 
equation a BS = P R T R a in + PrRrPrMms a BS + 
P R R R P R M£ S P L P Z 2ik x m {n)R m A m0 , with 
solution a B s = K-msrPrTr a-m + 

2ik x m K M SR^RVRMl s P L P l R m A m o. Thus the 
incident and reflected fields on the membrane surfaces 



On 
b„ 



2ikox r 



M b ai n + 2ik x m (R m I + M m M c 
The components of the relevant matrix 



i)^m0- 



(11a) 
(lib) 



M ax = PjPLMBsKMSRPRRRPaM^gPLPjiC. 

are presented in the Appendix. 

Substituting mean fields from Eqs. (8a, 8b) and pertur- 
bations fields (11a, lib) into Eq. (9), ignoring the D.C. 
part and linearizing with respect to perturbation terms, 
one ends up with F(Sl) — -Fba(^) + F X (SY). Here Fba 
is the radiation pressure noise considered in Sec. IV, and 
F x (0) = — fc(Cl)x m (n) is the ponderomotive force, i.e. 
dynamical part of the radiation pressure force caused 
by the motion of the membrane. The coefficient IC(Q) 
modifies the dynamics of the membrane, and therefore 
represents the dynamic back-action, 



£(fi) 
K(f2) 



2iko 
c 



Ft P 



(12) 



*J [a 3 -2M a;c (f!)]MU n , 



with cr 3 = diag(l, -1). If one denotes K(Q) = 3ft[/C(fi)] 
and r(f2) = — |Sy[K!(f2)]/fi, then the corresponding shifts 
of the square of intrinsic mechanical frequency and damp- 
ing rate are equal to K/m and Y/m [57]. 

The explicit formula for /C(f2) is rather involved in 
the general case. We therefore present it using the fol- 
lowing simplifying assumptions: (i) balanced beamsplit- 
ter, <5bs = 0, (ii) small displacements (Sx) of the mem- 
brane from the position corresponding to dark fringe, 
(Sx) = £/2, £ = 51 — Slup, SIdp = nXo/A, n is odd, 
fco£ ^ 1; an d (iii) single optical mode with narrow 
linewidth, r yC/c <C 1. We also introduce the notations 
(cf. Eqs. (6, 7)), 



7 = 7SR + 7m, 7SR 



C ^SR 

AC ' 



7n 



AC 
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A = S SR + 5 m , S SR = w - w c , <5 n 



± 



AC 



Eq. (13) reduces to 



Here cj c is the cavity resonance of interest in dark port 
regime, and the sign of S m alternates in the sequence of 
dark ports, starting with '+' for n = 1 (we assume that 
amplitude reflectivity and transmissivity are always posi- 
tive). Note that both shifts in linewidth (7 m ) and detun- 
ing (S m ) due to offset from dark fringe are quadratic in 
displacement. Under these assumptions Eq. (12) greatly 
simplifies to 



cC A 2 + ( 7 - til) 2 
f (5 S r[7 2 + A 2 - 4( 77m + Ay 
X \ 7 2 + A 2 

2i(7SR<5m + 7m^SR.)^ + S m fl 2 



+ 



7 2 + A 2 



(13) 



This dynamic back-action possesses rich properties due 
to the complicated dependence on A and il. For £ = 
(on dark port) Eq. (13) reduces to Eqs. (la, lb). Off 
dark port for £ ^ typical plots of the 'anomalous' 
optical rigidity K = K(A) and damping T = T(A) 
are illustrated in Fig. 2 c, d. One immediately notices 
that /C(^)|a=o 7^ in general case. For optical damp- 
ing this means that cooling of the membrane on reso- 
nance is possible. Several crossings of zero imply the 
appearance of additional regions of stability/instability 
on cither side of the resonance. Note that using the 
fluctuation-dissipation theorem, one can reproduce the 
curves for T = r(A;w m ) at fixed mechanical frequency 
uj m , from unsymmetrized back-action spectral density 
(10): since the emission/absorbtion rates of field quanta 
by the mechanical oscillator are defined by Sf(iw m ), 
optical damping is proportional to their difference, T ~ 
Sf^m) — Sf(-w m ), i.e. to the antisymmetric part of 
spectral density [2]. 

Remember that in the effective-cavity approach, the 
transformation of the 'canonical' Lorentzian profile of Sf 
into the mixture of Lorentz- and Fano-like ones is gov- 
erned by the interplay between dispersive and dissipative 
couplings in the cavity. Therefore, one can argue that the 
same mechanism leads to the transformation of 'canoni- 
cal' dynamic back-action into the 'anomalous' one. Dy- 
namic back-action corresponding to the pure dissipative 
coupling was considered in Ref. [45] in the context of cav- 
ity optomechanics. It was shown that although both op- 
tical spring and damping still remain antisymmetric with 
respect to A (and vanish at A = 0), damping acquires 
additional regions of stability /instability. 

Consider now a 100% reflective membrane in the MS 
interferometer. This is equivalent to a pure Michelson in- 
terferometer and, specifically, reproduces basic topology 
of the GW detectors where the differential motion of the 
end mirrors correspond to the motion of the membrane 
in the MS interferometer. Therefore the case of a quasi 
free mass, Q — > 0, is of particular interest. In this limit 



K 



AujoPu 



A 



r = - 



cC 7 2 + A 2 
4co P in 7 A 



477n 



cC ( 7 2 + A 2 ) 2 



- A 2 ^ 

7m 3 7 2 

7 



y 2 + A 2 



(14a) 
• (14b) 



Both K and T vanish on resonance, and one can check 
using Eq. (13) that this feature holds for any Q. Terms 
in square brackets in Eqs. (14a, 14b) represent the de- 
viations from 'canonical' formulas. According to them, 
optical sp ring can ha ve three zeroes at A = and 
A = ±^/ 7 (4 7m - 7), if 7 m > 7/4. Remember that 
the 'canonical' spring (la) only has one zero for small 
fi. Similarly, the optical damping can also cross zero 
three times at A = and A = ±7-^/ (37 m — 7 )/( 7 + 7m), 
if 7m > 7/3. Thus, for a large enough offset from 
dark fringe, one gets several intersecting regions of posi- 
tive/negative K and T, as illustrated in Fig. 2b. This may 
have an impact on the operation of advanced GW detec- 
tors, since they will utilize the DC-readout scheme, when 
a small offset from dark fringe is created artificially to 
get some mean power for homodyning, thus resulting in 
'anomalous' spring/damping, if A ^ and the offset from 
dark fringe £ is large enough. This can raise certain con- 
trol issues, in turn. For the 'anomalous' spring/damping 
to be manifest (at least at low frequencies), one can use 
the following rough estimation of the correspo nding value 
of £: 7m > 7srA or explicitly, £/A > a/T s 2 r /(87t 2 ). 
Note, however, that the MS interferometer under consid- 
eration includes neither power-recycling technique, nor 
arm-cavities, therefore this estimation should be applied 
to realistic interferometers with certain reserve. 

Accurate analysis of stability reveals that there exists 
a certain region of parameters where the set of K and 
T makes a stable configuration. This can be utilized 
for the reduction of quantum noise in the interferometric 
topologies, designed to overcome the standard quantum 
limit, that rely on the effect of optical spring (such as de- 
tuned SR-topologies, optical bars [49] and optical levers 
[49, 50]), since it becomes possible to sustain stable op- 
tical spring with only a single laser carrier, that is not 
possible with conventional optical spring. 



VI. OBSERVATION OF ANOMALOUS, 
TWO-SIDED DYNAMICAL INSTABILITY 

Our experimental setup was in direct analogy to 
Fig. 1. The Michelson-Sagnac interferometer [51] had 
an arm length of about 7.5 cm and contained a non- 
stoichiometric silicon nitride (SiN) membrane arranged 
such that its two transmitted and its two reflected 
beams overlapped with an interference contrast of greater 
99.9%. The MS interferometer acted as a compound 
retro-reflector for light that entered either of its two 
ports. Its reflectivity was a function of the microscopic 
position of the membrane along the direction of the laser 
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beam. We controlled the membrane position via a piezo- 
electric element (piezo). A highly reflective cavity mir- 
ror (i?| R = 99.97%) located in the signal output port, 
with a macroscopic distance of 1.2 cm to the beamsplit- 
ter, established a standing-wave signal-recycling cavity 
[52], whose second end mirror was defined by the MS 
interferometer. Similar to current gravitational wave de- 
tector arrangements, the light leaving this port was de- 
tected by a PIN photo diode. The experiment was car- 
ried out with laser light at a wavelength of 1064 nm. The 
membrane's normal incidence power reflectivity at this 
wavelength was Rf n — 17%. The membrane had a thick- 
ness of 40 nm, a side length of 1.5 mm and a resonance 
frequency of 133 kHz [53]. The interferometer was oper- 
ated inside a vacuum chamber to avoid gas damping or 
acoustic excitation of the membrane motion. We deter- 
mined the mechanical quality factor Q of the fundamen- 
tal oscillation mode for different pressures. As result, we 
found Q — 6 • 10 5 for gas pressures below 4 ■ 10 -6 mbar. 
A detailed description of the interferometer is given in 
Refs. [54, 55]. 

For all membrane positions our interferometric cav- 
ity arrangement operated outside the resolved sideband 
regime due to the membrane's low resonance frequency, 
the short cavity round trip length of 2 • 8.7cm, and intra- 
cavity losses mainly caused by the imperfect beam split- 
ter. The cavity thus resonantly enhanced the upper and 
lower signal sidebands produced by the membrane mo- 
tion as well as the remaining dim carrier light in a broad- 
band fashion. 

In a first series of measurements we positioned the 
membrane such that the carrier light of all four beams 
reflected off and transmitted through the membrane 
showed a strong destructive interference in the interfer- 
ometer's signal output port, i.e. established an almost 
dark port. We observed parametric cooling as well as 
heating as it is well-known for dispersive optomechanics. 
When the pump light was blue detuned with respect to 
the cavity resonance we observed strong heating of the 
mechanical motion. For a red detuned cavity we observed 
optical cooling as expected. In a second series of measure- 
ments we positioned the membrane such that about 1% 
of the input laser light was transmitted through the SR 
cavity, which corresponded to the maximal light trans- 
mission through the cavity arrangement possible. Fig. 4 
shows the light power transmitted through the SR cavity 
when the position of the SR mirror was slowly scanned 
over cavity resonance. At the start of the scan the SR 
cavity was too long to resonate. When the optical res- 
onance was approached, first, the dynamical instability 
occurred that is also present for operations close to the 
interferometer dark port. On cavity resonance the oscil- 
lations were rapidly damped indicating a region of stabil- 
ity. When the cavity was further shortened, not optical 
cooling but a second distinct instability occurred, as pre- 
dicted for the anomalous dynamic back-action off dark 
port. As shown in the right part of Fig. 4 the amplitude 
of this instability was significantly smaller than that on 
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FIG. 4: Black: Time series of the Michelson Sagnac inter- 
ferometer's output power P ou t while linearly decreasing the 
signal recycling cavity length. The dashed blue line is a lin- 
ear fit to the piezo voltage. For fast cavity length scans an 
undisturbed cavity resonance peak was found (solid orange 
line) since there was not sufficient time for the instabilities 
to build up. For slow scanning speeds, as given by the x-axis 
labeling, instabilities on both sides of the resonance were ob- 
served. Both resonances were dynamical, i.e. one or more fre- 
quencies were attributed to them. When the detuning crosses 
zero (resonant case), the oscillations were damped indicating 
a regime of stability. 



the left branch. 



VII. SUMMARY AND CONCLUSION 

In this paper we theoretically and experimentally ana- 
lyzed the optomechanics of a signal-recycled Michelson- 
Sagnac interferometer containing a semitransparent 
membrane. In contrast to previous works we did not 
restrict our consideration to the dark port regime of op- 
eration but rather considered a general situation cor- 
responding to the arbitrary position of the membrane. 
Such an interferometer can be equivalently described as 
an effective Fabry-Perot cavity with one of the mirrors 
having a reflectivity that depends on the position of the 
membrane. Mechanical motion of the latter modulates 
resonance frequencies and linewidth of the effective cav- 
ity, featuring the so-called dispersive and dissipative cou- 
plings. In particular, unsymmetrized spectral density of 
back-action noise exhibits the mixture of Lorentz- and 
Fano-like resonances, the latter owned to the interference 
of input and intracavity laser fields on the membrane. 

We then proceeded with the study of dynamic back- 
action effects, optical spring and optical damping. We 
found that in the interferometer operated off dark port, 
these effects behave differently from the conventional 
ones: both spring and damping become highly asymmet- 
ric with respect to detuning and acquire non-zero values 
at zero detuning. This, in principle, allows cooling of the 
membrane on resonance. Additionally, optical damping 
acquires several regions of stability and instability. 

We presented experimental data that indeed proves the 
existence of two regions of instability for a membrane 
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Michelson-Sagnac interferometer operated off dark port. 
The instabilities were observed for red as well as for blue 
detuned laser light. Both instabilities were dynamical 
and showed quantitative differences in their oscillation 
amplitudes. A detailed quantitative characterization of 
both instability regions is in progress. 

In the extreme case of a 100% reflecting membrane, 
corresponding to the well-studied pure Michelson inter- 
ferometer, dynamic back-action vanishes on resonance 
independently of the dark-port offset, but demonstrates 
'anomalous' features when operated off-resonance and off 
dark-port: both optical spring and damping exhibit sev- 
eral intersecting regions of positive/negative values (for a 
large enough offset). For a certain region of parameters 
this allows, in particular, maintaining the stable set of 
optical spring and damping with only a single laser car- 
rier in a free-mass interferometer. Moreover, advanced 
gravitational- wave detectors with DC-readout that are 
currently under construction, can also encounter anoma- 
lous optical spring off-resonance (given large enough off- 
set from the dark fringe), raising certain control issues. 

Our analysis thus demonstrates that the interferom- 
eters operated off dark port violate the scaling law in 
the sense that the latter one only covers the equivalence 
between a Fabry-Perot cavity and the interferometers op- 
erated at dark port. This opens new possibilities for de- 
signing the interferometer topologies aimed at reduction 
of quantum noise and overcoming the standard quantum 
limit in gravitational-wave detectors. On the other hand, 
in cavity optomechanics these effects may turn helpful for 
finding new regimes of cavity-assisted cooling. 
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Appendix A: Useful matrices 

Matrix M^: 

M^ M) = V- 1 [t bs (l - i? m i?sR.e 2ife(£+5 ' /2) 
+ R BS T m R SR e 2 * kc ]e^ L + l -^ 2 \ 

V-'[r bs (l + J R mJ R S R e ^ (£ ^ /2) ) 



+ T BS T m R SR e 



2ikC 



,ik(L+l+Sl/2) 



M^ 2) = 
Matrix M B : 



sft-lrp rp Ak(C+5l/2) 



4 M) 



T BS I R 



+ T m R BS e 



- Rsne 

ik(L+l-6l/2) 



2ik(C+Sl/2) 



4 M) 
4 2il) 



V-'Tsn (R BS R m + T m T BS e iksl ) e 



ikSl\ ik(C-Sl/2) 



= T>~ 



Rbs (i? m + W ifc(£ ^ /2) ) 



+ T m T BS e 



-ik6l 



ik(L+l+Sl/2) 



M (2,2) = v -i TsR ( TBsi?m _ Tm R BS e- lkSl ) e^ c+5l / 2 \ 
Matrix M ax : 

Mi 1 /) =V-iR m Rl s R SR e^ c - s ^\ 
Mi 2 /) = V-'R^TisRsne 2 ^ 61 ^, 
Mi 1 /) = Mi 2 /) - -V- l R m R BS T BS R SR e 2lkc . 
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